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A simple model of an irreversible process is introduced. The equation 
of iterations in the model includes a noise generation term. We study the 
properties of the system when the noise generation term is a stochastic pro- 
cess {e.g. a random number generator) or a deterministic process (e.g. a 
chaotic map) . We compare the time series obtained from the above imple- 
mentations of the model by use of statistical methods (such as Detrcndcd 
Fluctuation Analysis). The conclusion is that using statistical methods the 
two versions of the model are indistinguishable. The advantage of this ob- 
servation is that we may calculate the Lyapunov exponent for the model. 
As a result we obtain an equation relating the DFA exponents (a statisti- 
cal measure) with the Lyapunov exponent for such models. On the other 
hand, typical statistical properties can also be calculated, as for example 
the diffusion coefficient for a particle, which movement is defined by the 
above model. 

PACS numbers: 05.45. Tp, 05.40.-a, 02.50.-r 

1. Introduction 

Usually deterministic and stochastic analysis are not considered compat- 
ible. On one hand we are often limited to statistical analysis when dealing 
with experimental time series. On the other hand a purely stochastic ap- 
proach to data analysis may lead to an erroneous interpretation about the 
genesis of the analyzed system. 

In this work, we investigate, whether it is possible to substitute the Lya- 
punov exponent with a statistical measure, at least in simple 1-D systems. 
This may be valuable in the case when we do not know what is the equation 
behind the process we observe. It may also be useful when it is technically 
difficult to calculate the Lyapunov exponent ^ |2] ■ 
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In this paper, we use the so-called general random walk as our main 
model |31 We analyze the properties of this model when the noise 
components of the walk are generated by a stochastic process or a deter- 
ministic process (e.g. the tent map). Using Detrended Fluctuation Anal- 
ysis (DFA) [SI [7J |S] we compare the time series obtained from the above 
implementations of the model. The conclusion is that both implementations 
of the model lead to the same results. As a consequence of this observation, 
we calculate the Lyapunov exponent for the deterministic version of model. 
The result is an equation relating the DFA exponents (a statistical measure) 
with the Lyapunov exponent for our model, which is practically indepen- 
dent of the method used to generate noise. Using the Lyapunov exponent 
we may calculate the diffusion coefficient for a particle, which movement is 
defined by the model. By doing this we also doublecheck that the determin- 
istic implementation of the model has the same statistical properties as the 
purely stochastic one. 



1.1. The method 

Detrended Fluctuation Analysis (DFA) has been originally applied to 
the DNA walk [Hj. Therefore in general one needs to define a walk that 
is related to the input series analogously 7 . To do this, the input series 
{X(k)} of length N is integrated after subtracting their average value. The 
series {y(k)} is then: 

k 

y(k) = J2(X(i)-(X)), (1) 
i=i 

where X(i) is the i-th point of a discrete time series and (X) is the average 
value of the data. Next, the integrated series is divided into subintervals of 
equal length n, and for each subinterval a linear least squares fit to the y(k), 
denoted y n (k), is made (fig. 1). The RMS fluctuation around the regression 
line is then given by the equation: 



F(n) 



\ 



1 N 

-Y^[y(k) - y n (k)Y 



(2) 



k=l 



The dependence of F on the length n is examined via a plot of log F(n) 
versus log n (fig. 2). When scaling occurs, the overall slope of the line in 
the double-logarithmic scale is equal to the DFA exponent and denoted by 
a = log(e~ b F(n))(logn)~ l , where b is the intercept of the approximated 
trend. 
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Generally, when a scaling F(ri) oc n a is observed, the scaling exponent 
in the range 0.5 < a < 1 indicates positive long-range power-law correla- 
tions (in other words, persistence) and < a < 0.5 infers anticorrelations 
(antipersistence) 13 [SI - ct = 1.5 is obtained for the Brownian walk. The 
exponent a = 0.5 (fig. 2a) corresponds to uncorrelated data. 

If there are short-range correlations, the slope for low n may differ from 
0.5 but it will approach this value for large n. A crossover occurs when 
for different ranges of n we observe different slopes Crossovers in the 
linear dependence of the exponent on window size n have been observed in 
detrended fluctuation analysis of complex data {e.g. biological data) and 
may be an important indicator characterizing the underlying process [HUH- 

1.2. The model 
We define the model by the iterative equation: 

x-n+i = x n + £ n+ \ — ^ n+ i_Af . (3a) 

Here, n is the iteration index (a natural number), x n is the variable value 
at the n-th iteration and £ n is the noise term. The model equation (|3a|) is 
equivalent to: 

M-l 

X n= ( 3b ) 
i=0 

As explicitly written in equation (|3b|). our model is a system with memory, 
the range of which is defined by parameter M. This is an analogy to the 
general random walk process 

We use two processes to generate the noise £ n - a stochastic and a de- 
terministic one. In the first approach we use a stochastic process that has 
a uniform distribution with (£} = 0.5 and (CiCk) = &ik 

As a second approach we generate noise using chaotic maps. The follow- 
ing equation defines the tent map (also known as the symmetric triangular 
map) [DEI: 

£„+i = /(£n) = l-|l-2£ n |. (4) 

It is well-known ^ElEl that iterating eq. (JIJ) generates data which is equiv- 
alent to statistically uncorrelated noise with a uniform i.i.d. distribution. 
In other words, the natural invariant density E] for the tent map (jlj) is 
equal to /?(£) = 1. 

In this paper we also consider the generation of noise using the Ulam 
map ( i.e. the logistic map at fully developed chaos) pQ: 



= /(£«) = 4£„(l - £„). 



(5) 
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The main difference between the maps © and (@J) is that the natural in- 
variant density for the Ulam map does not correspond to the uniform dis- 
tribution 9 j, instead it is equal to: 

P(0 = J^ry (6) 

As we will show further, the differences between the maps @ and (JSJ) will not 
affect the results presented in this paper. To obtain a simple correspondence 
with the parameter x n we define £ n as: 

in+i = f{x n modl). (7) 

What is important for our study, this approach does not alter the slope of 
the chaotic map therefore it preserves the value of the Lyapunov exponent 
(though it introduces singularities). 

2. Analysis and comparison of the models 

2.1. The stochastic model 

First, let us focus on the stochastic version of the model given by eq. ©• 
As it can be seen in fig. 2 we observe a crossover for series obtain with 
parameter M/l. The point of crossover is found to be dependent on the 
parameter M. The dependence is a power-law and for larger M it occurs at 
larger n (fig. 3). A similar relation between the correlation range and the 
crossover point was assumed in [7] (without proof or reference to a model) 
and applied to the analysis of the heart rate variability series. 

We can find this dependence between the crossover point n c and param- 
eter M from numerical data (fig. 3): 

logn c = 0.4 log M + 0.4. (8) 

Therefore, it is possible to obtain the parameter M of the model © only 
by analyzing the time series (experimental data), e.g. using the statistical 
method DFA. 

For a pure random walk (M — > oo) it is easy to find the diffusion coeffi- 
cient D, which in the general case is defined as [31 lllj: 

Ux n - X ) 2 ) 

D = lim ^ '- (9) 

n^oo 2n 



As M — ► oo, eq. (jHJ) becomes 



E & ( 10a ) 

3=0 
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and, equivalently 

x i+ i = Xi + Ci+i- (10b) 
Therefore the diffusion coefficient of the pure random walk (|10|) is equal to: 

D. = «*> + «>' = I. (XI) 

2.2. The deterministic model 

The dependence of the properties of chaotic maps on the control pa- 
rameter is usually described by the Lyapunov exponent, which is a measure 
of the memory of the initial conditions. The Lyapunov exponent for one- 
dimensional iterated maps is calculated as [§1 EH \H\ : 



A = lim X(N, xn) = lim —In 



dF N (x ) 



j N-l 



lim — > In \F'{ 



Xi) 



dxo 

(12) 

where X{ corresponds to the i-th iteration of the map F(-) (in our case 
defined by eq. (j3J)) and xq is the initial condition. A negative value of 
A indicates periodic states, a positive A - chaotic states. In general the 
Lyapunov exponent is dependent of the initial condition xq, but in the case 
of the map defined by eq. © A = X(xq). 

Instead of calculating the Lyapunov exponent using the long-time limit 
lmi/v^oo A(iV) as in eq. (|12j) . this exponent may be calculated as the average 
of all the possible values of the one-step finite-time Lyapunov exponent 
Xi 0D2|: 

X = (Xi) ; Xi = In \F'(xi)\. (13) 



First, we will consider the case of the pure random walk, i.e. when 
M — > oo. The Lyapunov exponent (eq. (112(1 ) for the above general walk can 
be easily found if we note, that the inversion of the tent map (|IJ) gives two 
symmetric preimages £ n for each £„+i ^ El • 

To calculate the exponent A in our model we need to find the product 
of 2 M preimages. However, eq. (|13f) is the average of one-step Lyapunov 
exponents Aj. Due to the symmetry of the preimages of ([%]). there are two 
equally probable (in the statistical sense, as n tends to infinity) values of 
Xi, namely lnl and In 3. Therefore the Lyapunov exponent for the pure 
random walk is equal to: 

A = ~ln3. (14) 
We obtain the same calculation in the case of the Ulam map (JSJ) . 
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Now we will derive the relation between the Lyapunov exponent and the 
memory parameter M for the general random walk. At first, this seems a 
difficult task, because this time we have to find the values of the derivatives 
of all the preimages of x n+ \ up to 2 M possible values of x n -M+i- This step 
is a little similar to the construction of the Julia set, in the way that one 
needs to find calculate all the preimages values (compare pQ, p. 104). Yet it 
is well-known that the Julia set is quite complex. On the contrary, in this 
case, after simple calculations, a finite sum of a geometrical progression is 
obtained, and eq. ((T3*|) yields: 



In the above derivation we use the fact, that in the long-time limit (i.e. 
when averaging over infinitely many iterations) all values of the one-step 
Lyapunov exponents are equally probable. As we stated earlier, this is due 
to the symmetry of the two preimages in both the logistic map and the tent 
map. 

Concluding, we see that the Lyapunov equation depends only on the pa- 
rameter M and can be calculated from the equation: 



In 



( 9 _2 2 ^)(l-2 



2-2M 



(15) 



Note, that in the limit M — > oo we obtain eq. (|14|) which was calculated 
earlier for more clarity. 

The important observation now is that using the DFA method we have 
obtained the relation between the the crossover point n c and M (eq. Q, 
see fig. 3). This relation is valid for both the statistical model of eq. (J2J) 
and the deterministic models of eqs. @ and (J5J). 

This means that we can find the Lyapunov exponent for our model using 
only statistical analysis by comparing eqs. (fll)|) and (JSJ: 



A = - In 

4 




(16) 



We obtained a quite complicated relation, therefore, to doublecheck its 
correctness we show that the Lyapunov exponent approaches the limit: 



lim A 

Af^oo 



1 



In 3 



(17) 
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already for M > 10 (fig. 4). This is in agreement with the previous finding 
in eq. 1)141) obtained for pure random walk case. 

The diffusion coefficient may be calculated using the second term of the 
cumulant expansion of the one-step Lyapunov exponent 

D= lim ([A n -(A n )] 2 \ (18) 

Equation (|18[) for our model yields: 
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In 2 +ln 2 +ln 2 +ln 2 

Am Am Am Am 



(19) 



where A M = ^(9 - 2 2 ~ 2M )(1 - 2 2 ~ 2M ). 

The above equation in the case of the pure random walk (M — ► oo) 
yields: 

D\ = lim D = - In 2 3 (20) 

M^OD 4 

Comparing the above result to eq. (fTTj) obtained for the stochastic model: 

D\ — D s = 0.01. (21) 

Thus, we obtained a value which is close to the stochastic diffusion coefficient 
(|11|) . By comparing the basic statistical properties of stochastically and 
deterministically generated series we concluded earlier that the series are 
statistically equivalent. Eq. (|21jl may indicate that although the diffusion 
coefficient is only a statistical measure (as in eq. ©), it may be slightly 
sensitive to the dynamical genesis of the system. Still, it would be very 
difficult to use such a method even numerically, as usually the statistical 
errors are greater than the difference found in eq. (|21|) . 



3. Summary 

We studied the properties of the model defined by eq. (jSJ when the noise 
generation term is either a stochastic process or a deterministic process. We 
compared the time series obtained from the above implementations of the 
model by use of DFA. The conclusion is that the two versions of the model 
are indistinguishable using such statistical methods. The advantage of this 
observation is that we may calculate the Lyapunov exponent for the model 
defined by eq. ©• We obtain an equation relating the DFA exponents 
(a statistical measure) with the dynamical Lyapunov exponent for such 
models. On the other hand, typical statistical properties can be calculated 
in two ways: using statistical analysis or using equations of deterministic 
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non-equilibrium mechanics. As an example, we calculated the diffusion 
coefficient H'2U[) and obtained a value which is very close to the stochastic 
diffusion coefficient (fTTj) . 

The DFA software used in the calculations, is generously available from 
the authors of the method at the Physionet Database World Wide Web 
site (http://www.physionet.org [T3]). 
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Figure captions 

FIG. 1. In detrended fluctuation analysis the integrated series y(k) is lin- 
early approximated in each window of size n. Here, two cases of approxi- 
mation are shown on a fragment of a test series: for n = 500 (continuous 
lines) and n = 2000 (dashed lines). 

FIG. 2. DFA plots for time series from the model defined by eq. © at 
different parameter M values. The length of the time series were TV" = 10 5 . 
a): M = 1, this is equivalent to uncorrelated noise series b): M = 2. c): 
M = 5, a crossover occurs - we witness two slopes, d): M = 100, the 
crossover is shifted in respect to M = 5. For window sizes n smaller than 
the crossover point n c the slope value is near to 1.5 (corresponding to Brow- 
nian noise), for window sizes larger than n c it approaches 0.5 (white noise). 

FIG. 3. The equation (jHJ) obtained from numerical simulations. 

FIG. 4. The dependence of the Lyapunov exponent A and its variance on 
the parameter M. 
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